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CLAIMS 



[Claim(s)] 

[Claim 1] Coding video signal equipment characterized by coding said two or 
more objects so that it may be coding video signal equipment which codes two 
or more objects and coding timing of I picture of each aforementioned object 
may not lap in time. 

[Claim 2] provide a picture timing indicating device, two or more object coding 
equipment, and a multiplexing device, and said picture timing indicating device, 
So that timing of I picture which each aforementioned object coding equipment 
generates may not lap in time to said two or more object coding equipment, 
Specify, output a cycle of a picture, and information on offset and said two or 
more object coding equipment, After coding said object according to a cycle of said 
picture outputted from said picture timing indicating device, and information on 
offset, output and said multiplexing device. Coding video signal equipment 
characterized by outputting after multiplexing an object mark from said two or 
more object coding equipment. 

[Claim 3]Are two or more objects coding video signal equipment to code, and 
The area size Ai of the object i, An object weight, At— Pi (t) which multiplied the 
picture weight Pi (t) which changes on a time-axis calculated based on a 
picture weight of I picture which is a value which shows a degree of a 
generated code amount defined beforehand or a processing load at the time of 
decoding, P picture, and B picture 

The sum total added and set about all object, sigmaAi-Pi (t) 

Coding video signal equipment characterized by determining a cycle of a 

picture of each aforementioned object, and offset so that a ** time peak value 

may be set to MAXA and said MAXA may serve as the minimum. 

[Claim 4]providea picture timing indicating device, two or more object coding 

equipment, and a multiplexing device, and said picture timing indicating device, 

I picture which is a value which shows a degree of a generated code amount 

beforehand determined as the area size Ai of the object i, or a processing load 



at the time of decoding, An object weight, Ai-Pi (t) which multiplied the picture 
weight Pi (t) which changes on a time-axis calculated based on a picture 
weight of P picture and B picture 

The sum total added and set about all object. sigmaAi-Pi (t) 
So that a ** time peak value may be set to MAXA and said MAXA may serve as 
the minimum, A cycle of said picture after determining a cycle of a picture of 
each object, and offset, Output information on offset to each object coding 
equipment, and said two or more object coding eguipment, After coding said 
object according to a cycle of said picture outputted from said picture timing 
indicating device, and offset, output and said multiplexing device, Coding video 
signal equipment characterized by outputting after multiplexing said object mark 
from said two or more object coding equipment. 

[Claim 5]So that it may be coding video signal equipment which codes two or 
more objects, a cycle of a picture of each aforementioned object may be fixed 
and coding timing of I picture of each aforementioned object may not lap in 
time, Coding video signal equipment coding said two or more objects. 
[Claim 6] So that it may be a video-signal decoding device which decodes two 
or more objects using two or more CPUs and the maximum in said all CPUs of 
the maximum on a time-axis of a processing load in said CPU may become the 
minimum, A video-signal decoding device assigning said two or more objects 
to said two or more CPUs, and decoding them. 

[Claim 7]providea decollator, object quota equipment, two or more CPUs, and an 
image compositing device, and said decollator, An object multiple signal which 
two or more objects multiplexed is considered as an input, Based on directions 
of said object quota equipment, output each object mark to said CPU, and said 
object quota equipment, The maximum in said all CPUs of the maximum on a 
time-axis of a processing load in said CPU so that it may become the minimum, 
Contiol said decollator to output to said CPU which assigned two or more 
objects to said two or more CPUs, and was able to assign each 
aforementioned object, and said CPU, A video-signal decoding device after 
decoding said object from said decollator, wherein it outputs to said image 
compositing device and said image compositing device combines and outputs 
an image decoded from said CPU. 

[Claim 8]About the object i which is a video-signal decoding device which 
decodes two or more objects using two or more CPUs, and was assigned to 
each aforementioned CPU, the area size Ai of said object, A value, Ai-Pi (t) 
which multiplied the picture weight Pi (t) which changes on a time-axis 
calculated based on a picture weight which shows a degree of each picture of 
a processing load at the time of decoding beforehand defined for every I 
picture, P picture, and B picture 

sigmaAi-Pi (t) totaled about said all objects of the **** aforementioned CPU 
A video-signal decoding device characterized by assigning said two or more 
objects to said two or more CPUs, and decoding them so that MAXB may serve 



as the minimum when this time peak value is calculated, it is referred to as 
MAXA and the greatest MAXA about said all CPUs is set to MAXES after calculating. 
[Claim 9] provide a decollator, object quota equipment, two or more CPUs, and an 
image compositing device, and said decollator. Consider as an input an object 
signal which two or more objects multiplexed, and based on directions of said 
object quota equipment, output each aforementioned object mark to said CPU, 
and said object quota equipment, About the object i assigned to each 
aforementioned CPU, the area size Ai of said object, A value, Ai-Pi (t) which 
multiplied the picture weight Pi (t) which changes on a time-axis calculated 
based on a picture weight which shows a degree of a processing load at the 
time of decoding beforehand defined for every I picture, P picture, and B 
picture 

sigmaAi-Pi (t) totaled about said all objects of the **** aforementioned CPU 
When this time peak value is calculated, it is referred to as MAXA and the 
greatest MAXA about said all CPUs is set to MAXB, atter calculating, Said two or 
more objects are assigned to said two or more CPUs so that MAXB may serve 
as the minimum, Control said decollator to output each aforementioned object 
to each aforementioned CPU which was able to be assigned, and said CPU, A 
video-signal decoding device after decoding said object from said decollator, 
wherein it outputs to said image compositing device and said image compositing 
device combines and outputs an image decoded from said CPU. 
[Claim 10] Provide coding video signal equipment and a video-signal decoding 
device, and said coding video signal equipment, Code an object mark so that a 
picture may be generated by a cycle of a picture directed from said video- 
signal decoding device, and generating timing of offset, and said video-signal 
decoding device, Video-signal transmission equipment transmitting information 
on generating timing of a picture to said coding video signal equipment, and 
decoding said object mark from said coding video signal equipment so that the 
maximum on a processing load of CPU or a time-axis of a generated code 
amount may serve as the minimum. 

[Claim 1 1 ] Provide coding video signal equipment and a video-signal decoding 
device, and said coding video signal equipment, Code an object mark so that a 
picture may be generated by generating timing, such as a cycle of a picture 
directed from said video-signal decoding device, and offset, and said video- 
signal decoding device,! picture which is a value which shows a degree of each 
picture of a generated code amount beforehand determined as the area size Ai 
of the object i, or a processing load at the time of decoding, An object weight, 
Ai-Pi (t) which multiplied the picture weight Pi (t) which changes on a time-axis 
calculated based on a picture weight of P picture and B picture 
The sum total added and set about all object, sigmaAi-Pi (t) 
So that a ** time peak value may be set to MAXA and said MAXA may serve as 
the minimum, Video-signal transmission equipment determining a cycle of a 
picture of each aforementioned object, and offset, transmitting information on a 



cycle and offset of said picture to said coding video signal equipment, and 
decoding said object mark from said coding video signal equipment. 
[Claim 1 2J Coding video signal equipment which is coding video signal 
equipment which codes two or more objects, and is characterized by coding an 
object mark so that a picture may be generated by a cycle of a picture directed 
from a video -signal decoding device, and generating timing of offset. [Claim 
13] So that it may be a video-signal decoding device which codes two or more 
objects and the maximum on a processing load of CPU or a time-axis of a 
generated code amount may serve as the minimum. A video-signal decoding 
device transmitting a cycle of a picture, and information on offset to coding 
video signal equipment, and decoding an object mark from said coding video 
signal equipment [Claim 14] The area size Ai of the object i which decodes by 
being a video-signal decoding device which codes two or more objects, An 
object weight, Ai-Pi (t) which multiplied the picture weight Pi (t) which changes 
on a time-axis calculated based on a picture weight of I picture which is a 
value which shows a degree of each picture of a generated code amount 
defined beforehand or a processing load at the time of decoding, P picture, 
and B picture 

The sum total added and set about all object, sigmaAi-Pi (t) 

So that a ** time peak value may be set to MAXA and said MAXA may serve as 

the minimum, Video-signal transmission equipment determining a cycle of a 

picture of each aforementioned object, and offset, transmitting information on a 

cycle and offset of said picture to said coding video signal equipment, and 

decoding an object mark from said coding video signal equipment. 

[Claim 15] A recording medium which records data generated from Claims 1, 2, 

3 and 4 and coding video signal equipment of 12 descriptions. 

[Claim 16] A transmission medium which transmits data which carried out the 

Hakiri gear tooth from Claims 1,2,3 and 4 and an image coding generating 

device of 12 descriptions. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 

[0001] 

[Field of the lnvention]The technical field carried out in this invention]. Coding 
video signal equipment, a video-signal decoding device with which this 
invention performs coding and decoding of a digital image, 
Therefore, the coding video signal equipment, video-signal decoding device, 
video-signal intermediary who are related with transmission equipment and 
decrypt by dividing especially an original image into two or more image objects, 
and coding. 

[0002] 

[Description of the Prior Art] As the coding equipment of the conventional 

digital image, and a decoding device. MPEG 2 (ISO/IEC.) which is an 

international standard JTC1/SC29. N801. coding equipment of "ISO/IEC CD 

13818-1 information technology- Generic coding of moving pictures and 

associated audio ",1994.1 1 ), There is a decoding device. 

[0003] Dra wi ng 12 is structural drawing of the picture in the video signal of 

MPFU 2 In ng 12 , (a) is a display order of the picture in MPEG 2, and a 

decoding order foreword of a picture [ in / in (b) / MPEG 2 ]. 

[0004] Hereafter, the structure of the picture in MPEG 2 is explained using 

drawing 12 . The picture of MPEG 2 is divided into three, I picture, P picture, 

and B picture. 

[0005] First, I picture is a picture which decodes only by the picture. That is, it 
is a frame inner code-ized picture which performs the coding closed within the 
picture without performing prediction between pictures. 
[0006] Next, P picture is a picture which decodes an image by forward direction 
prediction. That is, P picture decodes like drawing 1 2 (a) based on the picture 
which performed forward direction prediction to I picture or P picture. The 
picture of forward direction prediction is compounded by the motion vector 
which shows the motion by I picture, P picture, and the picture of a basis. P 
picture decoded is compounded based on the mark of the difference of this 
forward direction estimated image and a forward direction estimated image. 
That is, since P picture is compoundable only with the differential code of a 
motion vector and a forward direction estimated image by performing forward 
direction prediction, in P picture, it becomes possible to combine the picture of 
one sheet with few marks from I picture. 

[0007] B picture is a picture which decodes an image by bidirectional prediction. 
That is, B picture decodes like drawing 12 (a) based on the picture which 
performed bidirectional prediction which doubled forward direction prediction 
and opposite direction prediction from the image, I picture or P picture, of two 



sheets. 1 tie picture of forward direction piediction is compounded by the 
forward direction motion vector which shows the motion by I picture or P 
picture, and the original picture. On the other hand, the picture of opposite 
direction prediction is compounded by the opposite direction motion vector 
which shows the motion by I picture or P picture, and the original picture. Two, 
a forward direction estimated image and an opposite direction estimated image, 
are averaged, and a bidirectional estimated image is compounded. B picture 
decoded is compounded based on the mark of the difference of this 
bidirectional estimated image and a bidirectional estimated image. That is, by 
performing bidirectional prediction. B picture is compoundable only with the 
differential code of two motion vectors and bidirectional estimated images. 
Since there are few differential codes with an estimated image than P picture 
since prediction higher-precision than forward direction prediction can be 
performed, and it ends by bidirectional prediction, B picture becomes possible 
[ compounding with marks fewer than P picture ]. 

[0008] Next. (b) explains the decoding order foreword of an image. 

Decoding of an image is decoded from 11 picture which can be decoded 
independently first. Next, in decoding of B1 , although 81 is displayed, since P1 
is required, P1 is decoded previously, next B1 and B-2 which are B pictures are 
decoded in order. That is, the display order and decoding order foreword of a 
picture are not necessarily in agreement, the coding video signal equipment of 
MPEG 2 outputs the mark of an image according to a decoding order foreword, 
and, on the other hand, the video-signal decoding device of MPEG 2 decodes 
an image in the order which received. 
[0009] 

[Problem to be solved by the invention] However, there were the following 
problems in the coding video signal equipment and the video-signal decoding 
device which perform coding and decoding of the above MPEG 2. 
[0010] It is a problem of smoothing of the generated code amount in object 
coding, and smoothing of the processing load at the time of decoding. 
[001 1 ]ln image coding, the object encoding method which codes 
independently for what is called every objects, such as the component which 
constitutes a picture, i.e., a background, a person, and an object that is 
moving, attracts attention. In object coding, since it codes for every object, it 
can perform simply searching edit of replacing a specific object etc., removing, 
etc., and a certain object. 

[001 2] In object coding, although coding of each object is performed based on 
three pictures, I picture, P picture, and B picture, like MPEG 2, When the time 
position of I picture of each object was doubled, the code amount 
concentrated on the generate time of I picture, and the throughput at the time 
of decoding had conversely the problem of concentrating at the time of 
processing of B picture. 

[001 3] First, the problem of a code amount is explained using drawing 1 , 



is an explanatory view of the problem of the code amount in object 

coding. 

[001 4] In drawing 1 , it is the mark yield with which (a) doubled the mark yield of 
the object A, (b) doubled the mark yield of the object B, and (c) doubled two 

objects. 

[001 5] As shown in (a) and (b), there are most mark yields at I picture which 
codes independently, and then they serve as order of P picture and B picture. 
Therefore, when the time position of I picture of two objects laps, the sum total 
generated code amount of two objects. As shown in (c), the problem of the 
probability of cell abolition increasing in the ATM network for which it becomes 
the maximum and what is [ the minimum difference ] large, and many amounts 
of buffers by the side of a mark and decoding are needed arises. 
[0016] -j 1 is an explanatory view of the problem of the processing load 
at the time of decoding in object coding. 

[001 7] In - , it is a processing load at the time of decoding with which 
(a) set the processing load at the time of decoding of the object A, (b) set the 
processing load at the time of decoding of the object B, and (c) doubled two 
objects. 

[001 8]As shown in (a) and (b), a processing load has most B pictures which 
need to combine two pictures, a forward direction and an opposite direction, 
by prediction, and then serves as order of P picture and I picture. Therefore, 
when the time position of I picture of two objects laps, the sum total processing 
load at the time of decoding of two objects, As shown in (c), in decoding by 
CPU by becoming the maximum and what is [ the minimum difference ] large, 
in order to guarantee the greatest processing load, problems, like more highly 
efficient CPU is needed arise. 

[001 9] In this case, it targets to realize the coding video signal equipment, 
video-signal decoding device, and video transmission system which smooth a 
generated code amount and the processing load at the time of decoding in 
view of this point. 
[0020] 

[Means for solving problem] In the coding video signal equipment which codes 
two or more objects, the 1st invention in an application concerned codes an 
object so that the generating timing of I picture of two or more objects may not 
overlap. 

[0021] In the 1st invention in an application concerned, smoothing of the code 
amount which coding video signal equipment generates, and smoothing of the 
processing load at the time of decoding are realizable by coding the generating 
timing of I picture by the above mentioned composition, so that it may not 
overlap for every object. 

[0022] In the video-signal decoding device with which the 2nd invention in an 
application concerned decrypts two or more objects by two or more CPUs, 
From the area of the generating timing of the picture of two or more objects, 



and the field of an object, on the time-axis of a CPU processing load, the 
maximum in all the CPUs of the maximum assigns and decodes an object to 
each CPU so that it may become the minimum. 

[0023] In the 2nd invention in an application concerned, the above mentioned 
composition enables it to realize smoothing of the processing load in each CPU. 
[0024]The 3rd invention in an application concerned so that the coding video 
sicjiKtl equipment which codes an object, and a , " i it'"i '<de amount and 3 
processing load may become smooth according to directions of the generating 
timing of the cycle and offset of the picture from a video-signal decoding 
device, It is a video transmission system which turns into coding video signal 
equipment from the video-signal decoding device which points to the 
generating timing of the cycle and offset of a picture, and decodes the image 
object which received. 

[0025] In the 3rd invention in an application concerned, the above mentioned 
composition enables it to realize smoothing of the generated code amount for 
decoding in a video-signal decoding device, and smoothing of a processing 

load. 
[0026] 

[Mode for carrying out the invention] 

(A 1st embodiment) The coding video signal equipment in a 1 st embodiment of 
this invention is explained hereafter, referring to Drawings. 
[0027] Drawing 3 is a block diagram of the coding video signal equipment in a 
1st embodiment of this invention. As for 31, in drawing 3 , object coding 
equipment and 35 are multiplexing devices a picture timing indicating device, 
and 32, 33 and 34. 

[0028] In the coding video signal equipment of this embodiment constituted as 
mentioned above, the operation is explained hereafter. 

[0029]As a mark to code, the object mark which consists of two or more image 
objects is considered. 

[0030]About an object mark, "ISO/EC JTC1/SC29/WG1 1 N1240" has the 
description, for example. 

[0031 ] In object coding, the component which constitutes a picture, i.e., a 
background, a person, the object that is moving, etc. code a picture 
independently for what is called every object. 

[0032]As a HARASHIN item, a signal like drawing 4 is considered by this 
example. Drawing 4 is an explanatory view of the HARASHIN item in a 1st 
embodiment of this invention, 41 is an original image and 42, 43, 44, 45, and 
46 are image objects. 

[0033] D raw ing 4 shows the picture of one sheet in picture image data. At 
, 42 to which the picture 41 of one sheet hits a background, the 
object 43 to which the inside of a background is moved, and also the object 43 
comprise the body 44, the wheel 45, and the wheel 46. That is, in an object 
mark, the original image 41 is divided into the background 42, the body 44, the 



wheel 45, and the wheel 46, and the compression code of each is carried out. 
[0034] In the original image 41. it has a field of rectangular form as shown by a 
dotted line, these fields correspond to the picture of MPEG, and each image 
object is coded for every image object. The field of each object is described by 
the coordinates of the point at the upper left of rectangular, and the information 
on the length of the neighborhood of length and width, and is used at the time 
of decoding. 

[0035]As mentioned above, an original image is divided into an image object 
and the case where it codes, respectively is hereafter explained using 

3. 

[0036] In the coding video signal eguipment of this example, although it codes 
with the one object coding equipment 32, 33, and 34, respectively, one image 
object, Under the present circumstances, by the generating timing of the 
picture which Ih 1 j indicating (I t < 1 h ot t coding 

equipment codes, and the multiplexing device 35 multiplexes the output of each 
object coding equipment 32, 33, and 34, and it outputs. 
[0037]The deciding method of the generating timing of the picture in the 
picture timing indicating device 31 is hereafter explained using figures. 
[0038]' is a flow chart of the deciding method of the generating 

timing of a picture. In > 4 , -6 c/ ind me flow 

chart items. [0039] Drawing 6 is an explanatory view of calculation of the 
temporal change of an object weight. As for the temporal change of a picture, 
and (b), in drawing 6, the temporal change of a picture weighting coefficient 
and (c) of (a) are the temporal changes of an object weight. 
[0040]A picture weight is a value used as the rule of thumb of the mark yield of 
each picture, and the processing load at the time of decoding. 
[0041 ] In this example, for every I picture, P picture, and B picture as a value 
which shows the weight of a picture beforehand according to a generated code 
amount or the processing load at the time of decoding. It assumes that the 
picture weighting coefficient was decided and the picture weighting coefficient 
of WPP and B picture is set [ the picture weighting coefficient of I picture ] to 
WPB for the picture weighting coefficient of WPI and P picture. 
[0042]The picture weighting coefficient used as a standard is determined 
about the coding which coding video signal equipment generates using whether 
a generated code amount is thought as important or the processing load of 
CPU is thought as important, and information. 

[0043] In thinking on the basis of a generated code amount, it becomes 
WPI>WPB>WPP from , , and , and it becomes WPB>WPP>WPI 

in thinking on the basis of the throughput at the time of decoding. 
[0044] In this example, the cycle N of I picture is set constant and presupposes 
that it is the cycle N= 6 like drawing 6 . 

[0045]At this time, the offset M of I picture can take the value of 1 to (N-1). 
Like drawing 6 (a), when the picture of a certain object changes in time, a 



picture weighting coefficient changes like drawin g 6 (b). 

[0046]The temporal response of the picture weighting coefficient of the object 

K in case offset is M will be shown with the function PMK (t). 

[0047] Next, a actual generated code amount and the processing load at the 

time of decoding. Since it is proportional to the area of the field of an object, if 

field area of the object K is set to AK, after all, the object weight time function 

which is a function which shows the temporal change of the generated code 

amount of each object or the processing load at the time of decoding will be 

shown by ak-pmk (t) , and will become like drawing 6 (c). 

[0048]Therefore, the function which added this object weight time function 

about all the objects is as follows. 

[0049] 

[Mathematical formula 1] 



[0050] this (several 1) — it becomes a time function of the generated code 
amount of the mark which coding video signal eguipment generates, or the 
processing load at the time of decoding. 

[0051] The maximum MAXi about the time of this function is calculated about 
the combination of offset of all the objects. Namely, when the number of 
objects is four and offset is six like this example, About 24 combination, MAXi 
is calculated, a picture timing indicating device chooses the combination of the 
offset from which MAXi serves as the minimum, and the generating timing of a 
cycle and the picture of offset is directed to the object coding eguipment 32, 
33, and 34. 

[0052] Draw j " is the example computation of an object weight time function, 
(a) in : The example computation of the temporal change of the object 

weight of the image object 42, (b) The example computation of the temporal 
change of the object weight of the image object 44, As for the example 
computation of the temporal change of the object weight of the image object 
45, and (d), the example computation of the temporal change of the object 
weight of the image object 46 and (e) of (c) are the example computation of 
the temporal change of the sum total of an object weight. 
[0053] It becomes possible to make the peak value of a generated code 
amount small by coding the object from which the position of I picture of each 
object shifts like i > g 7. Thus, when a generated code amount is made 
smooth in time, there is a merit of the probability of the packet discarding in 
that there are few resources, such as a buffer by the side of mark equipment 
and a decoding device, and they end and a network decreasing. Since the 
processing load at the time of decoding which serves as the maximum at the 
time of B picture reproduction as shown in drawing 3 by coding an object is 
also smoothed in time so that the position of I picture may be shifted 



simultaneously, It becomes possible to decode the object mark of the same 
image quality by CPU with lower performance. 

[0054]Although the picture weighting coefficient to a generated code amount 
was considered by this example and the case where offset of each object was 
calculated was considered by it, also when considering the processing load at 
the time of decoding in the first place, smoothing of the throughput at the time 
of decoding can be realized by changing a picture weighting coefficient and 
using the same technique. 

[0055] In this example, although the cycle of the picture was set constant about 
all the image objects, it is effective in becoming possible to consider only 
offset and to perform calculation of an object weight function within a cycle, 
like this example, and calculation becoming simple by doing in this way. 
[0056] (A 2nd embodiment) The video-signal decoding device in a 2nd 
embodiment of this invention is explained hereafter, referring to Drawings. 
[0057] Drawing 8 is a block diagram of the video-signal decoding device in a 
2nd embodiment of this invention. As for a decollator and 82, in 
CPU and 86 are image compositing devices object quota equipment, and 83. 
84 and 85 81. 

[0058] In the video-signal decoding device of this embodiment constituted as 
mentioned above, the operation is explained hereafter. 
[0059]As a mark to decrypt, the object mark which consists of two or more 
image objects is considered. The picture shown in drawing 4 which explained 
by a 1st embodiment as an original image is considered, and the object mark 
which coded this original image with the coding video signal equipment of a 1st 
embodiment is considered as a HARASHIN item. That is, the composition of I 
picture in each object, P picture, and B picture assumes that it has become like 

. Multiplex [ of the cycle of the area size of each image object, I 
picture, P picture, and B picture and the information on offset ] shall be carried 
out to the HARASHIN item which multiplexed these image objects. 
[0060] In the coding video signal equipment of drawing 8 which received such 
a signal, the HARASHIN item is first inputted into the decollator 81 . The 
decollator 81 outputs the object mark of each object to CPUs 83, 84, and 85 
which decode them based on directions of the object quota equipment 82. Analyze 
the object quota equipment 82 and the HARASHIN item The area size and I 
picture of each object, It directs to the decollator 81 so that the maximum in all 
the CPUs of the time maximum of the processing load in CPU may serve as the 
minimum from the cycle of P picture and B picture, and the information on 
offset, and each image object may be assigned to each CPU. 
[0061 ]Now, the example which assigns an image object to two CPUs is 
hereafter explained using figures. 

[0062] Drawing 9 is a flow chart of the CPU quota determination of the object in 
the object quota equipment 82. 

[0063] In d rawing 9, 91, 92, 93, 94, 95, 96, 97, and 98 are flow chart 



items. [0064] Drawing 1 0 is an explanatory view of CPU assignment of the 
image object in object quota equipment. 

[0065] (a) in drawing 1 0 T he example computation of the temporal change of 
the object weight of the image object 42, (b) The example computation of the 
temporal change of the object weight of the image object 44. The example 
computation of the temporal change of the object weight of the image object 
45 and (d) (c) the example computation of the temporal change of the object 
weight of the image object 46 and (e). In CPU84 the example computation of 
the sum total of the temporal change of the object weight at the time of 
processing the image object 42 and the image object 45 in CPU83, and (f), It is 
the example computation of the sum total of the temporal change of the object 
weight at the time of processing the image object 44 and the image object 46. 
[0066]Object weights are a mark yield and a value used as the rule of thumb of 
the processing load at the time of decoding. 

[0067] In this example, for every I picture, P picture, and 8 picture as a value 
which shows the weight of a picture beforehand according to the processing 
load at the time of decoding, It assumes that the picture weighting coefficient 
was decided and the picture weighting coefficient of wpp and B picture is set 
[ the picture weighting coefficient of I picture ] to WPB for the picture 
weighting coefficient of WPI and P picture. 

[0068] In thinking on the basis of the processing load at the time of decoding, 
it becomes WPB>WPP>WPI from drawing 2 . 

[0069]The temporal response of the picture weighting coefficient of the object 
K will be shown by function PK (t). 

[0070] Object weight time-function ak-pk (t) is computed for the value which 
multiplied AK for the field area of each object K by this function. since this object 
weight function is the value which multiplied the coefficient of the processing 
load at the time of decoding for every picture, and the field area of each object, 
it turns into a time function which shows the processing load at the time of 
decoding of each object mostly. [0071 ] For example, the object weight time 
function corresponding to each objects 42, 44, 45, and 46 turns into a function 
as shown in (a), (b), (c), and (d). 

[0072] Next, about all the assignment of each object to each CPU. The sum 
total of an object weight time function The object assigned to sigma ak-pk (t) K= 
each CPU is calculated, and the maximum MAm (m= 1 .. the number of CPUs) 
on the time-axis of the object weight in all the CPUs is calculated. [0073] The 
maximum of MAm about all the CPUs is calculated further, and it is referred to 
as MBn (n= 1 .. the number of combination of assignment to CPU of an object). 
[0074] Since the quota method to CPU of the object that MBn serves as the 
minimum, i.e., the maximum of the processing load of each CPU, is the quota 
method used as the minimum, the object quota equipment 82 chooses this 
quota method, and it directs to the decollator 81 .[0075] Like this example, 
when considering two, 83 and 84, as a CPU and considering four, 42, 44, 45, 



and 46, as an image object, the combination of assignment of the following 
(Table 1) seven things can be considered. 

[0076] 
[Table 1] 



[0077] CPUs 83, 84, and 85 decode the object from the decollator 81 , 
respectively, and output it to the image compositing device 86. 
[0078]The image compositing device 86 compounds the object from each 
CPUs 83, 84, and 85, and outputs by using an original image like 41 of drawin g 
4. [0079] Since the assignment to CPU of an object which makes the minimum 
the time maximum of the processing load in CPU is realizable by the above 
operation according to the video-signal decoding device in this embodiment, It 
becomes realizable [ probability reduction of lack of the image by shortage of 
processing time, etc., and decoding by CPU of low performance ].[0080] In 
this example, although CPU described two examples, also when three or more 
CPUs exist, the peak value of a CPU processing load can be minimized with the 
same object quota method. 

[0081 ](A 3rd embodiment) The video-signal transmission equipment in a 3rd 
embodiment of this invention, coding video signal equipment, and a video- 
signal decoding device are explained hereafter, referring to Drawings. 
[0082] i is a block diagram of the video-signal transmission 
equipment in a 3rd embodiment of this invention. In drawing 1 1 , 1 1 1 is coding 
video signal equipment and consists of the picture timing indicating device 
1111, the object coding equipment 1112, 1113, and 1114, the multiplexing 
device 1115, and the picture-data transceiving equipment 1116. 1 1 2 is coding 
video signal equipment and consists of the picture timing indicating device 
1121, the object coding equipment 1 1 22, 11 23, and 1 1 24, the multiplexing 



device 1 125, and the picture-data transceiving equipment 1 126. 1 13 is a 
video-signal decoding device and consists of the picture timing calculation 
equipment 1131, the picture-data transceiving equipment 1 132, the 
multiplexing device 1 134, CPU1 135. and the image memory 1 136. 
[0083] In the video-signal transmission equipment of this embodiment 
constituted as mentioned above, the operation is explained hereafter. 
[0084]As a mark to decrypt, the object mark which consists of two or more 
mi. nit 5 uhh ( Is i i !<lt,h i j M i Inii I > • Mii< I i n> him"! by a 1 st 

embodiment as an original image is considered, and it carries out to coding the 
objects 44, 45, and 46 which hit a train with the coding video signal equipment 
1 1 1 in coding of the image object 42 which hits a background with the coding 
video signal equipment 1 12. 

[0085] First, the picture-data transceiving equipment 1 1 16 of the coding video 
signal equipment 1 1 1 outputs the information on the field of an object of the 
image object 42 which the coding video signal equipment 1 1 1 codes to the 
video-signal decoding device 1 13. Similarly, the picture-data transceiving 
equipment 1 1 26 of the coding video signal equipment 1 12 outputs the 
information on the field of the image object of the image objects 44, 45, and 46 
which the coding video signal equipment 1 1 2 codes to the video-signal 
decoding device 11 3. [0086] The video-signal decoding device 113 from the 
coding video signal equipment 1 1 1 and the coding video signal equipment 1 12. 
With the picture-data transceiving equipment 1132, receive and an image 
object in the picture timing calculation equipment 1131. With the picture 
weighting coefficient which are a generated code amount and a value which 
shows the weight of the picture beforehand defined according to the 
processing load at the time of decoding for every information on the field of 
these image objects, I picture and P picture, and B picture. The time position of 
I picture of each object does not overlap, but the generation cycle of the 
picture of each object and offset are determined that time smoothing of a 
processing load or smoothing of a generated code amount is realized. The 
decision algorithm at this time is completely the same as that of the decision 
algorithm of the picture timing indicating device 31 of the coding video signal 
equipment of drawing 3 in the working example 1 . 

[0087] Therefore, if the coding video signal equipment 1 1 1 and the coding video 
signal equipment 1 12 code with directions of the video-signal decoding device 
1 13, the object mark of the picture structure shown in drawing 7 will be 
outputted. 

[0088]The picture timing calculation equipment 1 131 outputs the cycle of the 
picture which did in this way and was determined, and offset to the picture- 
data transceiving equipment 1 132. 

[0089] Next, the picture-data transceiving equipment 1 132 outputs the cycle of 
these pictures, and the information on offset to the coding video signal 
equipment 111 and the coding video signal equipment 112. 



[0090]The coding video signal equipment 1 1 1 which received the cycle of 
these pictures and the information on offset codes the image object 42 
according to this. The coding video signal equipment 1 12 which received the 
cycle of a picture and the information on offset codes the image objects 44, 45, 
and 46 according to this. [0091 ] With the object information transceiving 
equipment 1116, the coding video signal equipment 1 1 1 receives the cycle of I 
picture, and the information on offset, and gives this information to I picture 
timing indicating device 1111. 

[0092] I picture timing indicating device 1111 directs the generating timing of a 
picture to the object coding equipment 1112. 1113, and 1114 based on these 
information. In this example, the generating timing of the picture which can 
compound the image object 42 which has picture structure as shown in 

is directed to the object coding equipment 1 1 12. [0093] Based on 
these directions, the object coding equipment 1112. 1113, and 1114 codes an 
object, and outputs. The image object 42 is coded and outputted in this 
example. 

[0094]The multiplexing device 1115 multiplexes the object mark from these 
object coding equipment 1112, 1113, and 1114, and outputs as an output of 
the coding video signal equipment 1 1 1 .[0095] Coding is performed in the same 
procedure by the coding video signal equipment 1 12. With the picture-data 
transceiving equipment 1 126. namely, the cycle of a picture, The information on 
offset is received, it outputs to the picture timing indicating device 1121, and the 
picture timing indicating device 1121 directs the generating timing of I picture 
to each object coding equipment 1 122, 1 123, and 1 124. Each object coding 
equipment 1 1 22, 11 23, and 1 1 24 is outputted, after coding the objects 44, 45, 
and 46 and multiplexing with the multiplexing device 1 125 according to the 
generating timing of a picture. 

[0096] As for the video-signal decoding device 1 13 which received the signal 
from these coding video signal equipment 1 1 1 and the coding video signal 
equipment 1 1 2, the multiplexing device 1 13 multiplexes the signal from two 
pieces of the coding video signal equipment 1 1 1 and 1 12 first. 
[0097] Next, CPU1 135 decodes each image objects 42, 44, 45, and 46, and 
outputs them to the image memory 1 136, and also the image memory 1 136 
outputs an image, and the original image 41 can be obtained. 
[0098]According to the video-signal transmission equipment in this 
embodiment, by the above operation, mthe case where obtain an image object, 
decode with a video-signal decoding device, and an image is combined from 
two or more coding video signal equipment, It becomes possible to decrease 
probability, such as lack of the image by shortage of processing time, since 
generating of the image object that the load of processing of decoding in a 
video-signal decoding device becomes smooth in time is realizable, Since 
smoothing of the yield of a mark is realizable, there is a merit of the probability 
of the packet discarding on a network that there will be few buffers by the side 



of a mark and decoding, and they will end being reduced. 

[0099] In this example, although coding video signal equipment described two 

examples, also when three or more coding video signal equipment exists, the 

processing load of a video-signal decoding device and time smoothing of a 

generated code amount can be attained by the same method. 

[01 00]a y considering the terminal unit with which coding video signal equipment 

and a video-signal decoding device were united. This invention is effective also 

in the processing load in the case of compounding the image object of remote 

coding video signal equipment, and the image object of a terminal unit, and 

creating a certain picture, and time smoothing of a generated code 

amount. [01 01] 

[Effect of the Invention] In the coding video signal equipment which codes two 
or more image objects according to the 1st invention in an application 
concerned as explained above, Smoothing of the code amount which coding 
video signal equipment generates, and smoothing of the processing load at the 
time of decoding are realizable by coding an image object so that the 
generating timing of I picture of two or more image objects may not overlap. 
[01 02] In the video-signal decoding device which decrypts two or more image 
objects by two or more CPUs according to the 2nd invention in an application 
concerned, From the area of the generating timing of the picture of two or more 
image objects, and the field of an object, so that the maximum in all the CPUs 
of the maximum on the time-axis of the processing load in CPU may become 
the minimum, An object is assigned to each CPU and it becomes possible by 
decoding to realize equalization of the processing load in each CPU. 
[0103]So that the coding video signal equipment which codes an image object, 
and a processing load and a generated code amount may become smooth 
according to directions of the generating timing of the picture from a video- 
signal decoding device according to the 3rd invention in an application 
concerned, With the video-signal transmission equipment which points to 
coding video signal equipment to the generating timing of a picture, and turns 
into it from the video-signal decoding device which decodes the image object 
which received so that two or more decoding timing of I picture of an object 
may not overlap. It becomes possible to realize smoothing of smoothing and 
the generated code amount of the processing load for decoding in a video- 
signal decoding device. 



[Translation done.] 
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